AMENDMENTS TO THE DRAWINGS : 

The attached two (2) sheets of drawings include changes to Figs. 1-3. The 
attached replacement sheets, which include Figs. 1-3, replace the original sheets including Figs. 
1- 3. In Figs. 1-3, descriptive legends for the boxes have been provided. 
5 Attachment: (2) Replacement Sheets 
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Remarks 

This Preliminary Amendment cancels without prejudice original claims 1 to 7 in 
the underlying PCT Application No. PCT7DE03/01737, and adds without prejudice new claims 
8-26. The new claims conform to U.S. Patent and Trademark Office rules and do not add new 
matter to the application. 

In accordance with 37 C.F.R. § 1.125(b), the Substitute Specification (including 
the Abstract, but without the claims) contains no new matter. The amendments reflected in the 
Substitute Specification (including Abstract) are to conform the Specification and Abstract to 
U.S. Patent and Trademark Office rules or to correct informalities. As required by 37 C.F.R. 
§ 1.121(b)(3)(ii) and §1.1 25(c), a Marked Up Version Of The Substitute Specification comparing 
the Specification of record and the Substitute Specification also accompanies this Preliminary 
Amendment. In the Marked Up Version, bold underlining indicates added text and strikeout 
indicates deleted text. Approval and entry of the Substitute Specification (including Abstract) are 
respectfully requested. 

The underlying PCT Application No. PCT/DE03/01737 includes an International 
Search Report, dated November 26, 2003. The Search Report includes a list of documents that 
were uncovered in the underlying PCT Application. A copy of the Search Report accompanies 
this Preliminary Amendment. 

It is asserted that the subject matter of the present application is new, non-obvious, 
and useful. Prompt consideration and allowance of the application are respectfully requested. 

Respectfully Submitted, 
KENYON & KENYON 



Dated 




One Broadway 
New York, NY 10004 
(212) 425-7200 
CUSTOMER NO. 26646 
PATENT & TRADEMARK OFFICE 
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DEVICE FOR PROJECTING AN OBJECT IN A SPACE OF A VEHICLE 

5 

BACKGROUND OF THE IN VENTION 

Background Inf ormation Field of the Invention 

10 The present invention is directed to a device for projecting 
an object in a space of a vehicle according to the definition 
of the opecico — in the independent claim . 

Description of Related Art 

15 

US — U.S. Patent No . 6 , 236 , 968-- B4- describes an automatic dialog 
system which helps a driver remain alert by conducting a 
conversation with the driver on different topics. For this 
purpose, the system has a voice recognition module and a 
20 speech generating module. Speech synthesis or stored speech 
may be used for this purpose. 

Advantagco of the Invention SUMMARY OF THE INVENTION 

2 5 The device according to It is an object of the prcocnt 

invention for projecting to project an object in a space of a 
vehicle, having the features of the — independent — claim, — hao the 
advantage over the related art that it which displays an 
obj ect artificially. 

30 

An object io undcrotood here ao These and other objects of the 
invention are achieved by artificially displaying an object 
which can be an artificial figure, an animal, or another 
creature-like representation, such as fantasy creatures. An 
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object may also be displayed using this device. The driver is 
thus provided with an artificial companion and a helper in a 
very intuitive manner. Space in this context refers to the 
passenger compartment. By displaying animals, mythical 
creatures, or objects, a pleasant environment may be created 
for the driver, so that a human voice or directly addressing a 
person may be dispensed with, and the driver's attention may 
also be drawn to different driving situations by the barking 
of a dog, for example. 

BRIEF D ESCRIPTION OF THE DRAWINGS 

The invention will be described in greater detail with 
reference to the following drawings wherein: 

Figure 1 shows the driver and the passenger projection. 

Figure 2 shows a block diagram of the device according to the 
present invention . 

Figure 3 shows another block diagram of the device according 
to the present invention. 



DETAILED DES CRIPTI ON OF THE INVENTION 

25 

The mcaaurco recited in the dependent claimo make advantagcoua 
improvemcnto on and rcfincmcnto of the device deacribed in the 
independent claim poooiblc. 

30 It is advantageous in particular that a voice input and output 
is associated with the device. A voice recognition system and 
a voice synthesis, i.e., voice generating system, are thus 
associated with the device. This enables the preferably 
projected figure to output speech and process the driver's 
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statements. A dialog between people may thus be simulated, 
which helps the driver to kill time, for example, and enables 
the driver to receive useful instructions regarding rest 
periods, driving conditions, or technical monitoring of the 
5 vehicle via the artificial figure. Speech analysis, i.e., the 
driver's statements, also allows conclusions to be drawn 
regarding the driver's condition. The dynamics of the speech, 
diction, and accentuation allow conclusions to be drawn 
regarding the driver's degree of excitement or condition in 
10 general . 

It is furthermore advantageous that the device is configured 
for holographic projection of the figure. The well-known 
technology of holography permits a figure"s projection to be 
15 represented three-dimensionally . This allows a mature and 

reliable technology, which is also very flexible, to be used. 

In addition, it is advantageous that the device allows the 
driver to select the figure to be projected. This selection 

20 may concern appearance, voice, sex, and size as exemplary 

selection parameters. The driver may thus create a pleasant 
artificial companion for himself /herself . This should also 
contribute to an improved driving style. The selection may be 
supported by a stored catalog of typical human figures, for 

25 example. When making this selection, the driver may use 

his/her own stored data or data captured via communication 
means to create the appropriate figure. For example, a driver 
may select his or her spouse or friend for the projection. 

30 It is furthermore advantageous that the device is connectable 
to a sensor system for monitoring the driver and/or the 
vehicle, the device influencing the projection of the figure 
and the speech output as a function of a first signal of the 
sensor system. This enables the artificial figure to respond 
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to the driver's actions and the condition of the vehicle. A 
particularly human behavior is thus artificially simulated. 
Driver support, i.e., a driver assistance system, may thus be 
implemented. Using this data, the projected figure may provide 
5 the driver with instructions regarding driving style, 

technical conditions, or the route selected by the driver. The 
projected figure may also calm the driver down or prevent the 
driver from falling asleep. By appropriately configuring the 
computing capability assigned to the artificial figure to 
10 process these sensor signals and respond in an appropriate 

manner, the behavior of the artificial figure may be refined. 

It is furthermore advantageous that the device projects the 
figure as a function of a second signal from a seat occupancy 
15 recognition system. The projected figure is only projected if 
the seat on which the figure is to be projected is unoccupied. 
The figure itself may be projected as a sitting person or as a 
smaller person floating in space. It is also possible, for 
example, to only project part of the figure, for example, the 

2 0 head with the upper body. 

It is furthermore advantageous that the device is connected to 
at least one communication means in such a way that the device 
influences the projection of the figure as a function of a 
25 third signal from the communication means. This permits, for 
example, persons called on the phone to be represented by the 
projection as if they were present in the vehicle. This makes 
a particularly lively discussion or a particularly natural 
sounding conversation possible. The data for representing this 

3 0 figure may be previously stored in a memory located in the 

vehicle or it may be transmitted via the communication means. 
The data may be generated at the same time by the conversation 
partner via an appropriate scanning device at the person's 
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location so that the person is then reproduced live as a 
projection in the vehicle. 

Drawing 

5 

Exemplary cmbodimcnto of the present invention arc illuotratcd 
in the drawing and explained in greater detail in the 
following description . 

10 Figure 1 shows the driver and the passenger projection; Figure 
2 shows a block diagram of the device according to the present 
invention; and Figure 3 shows another block diagram of the 
device according to the present invention. 
Description of the Exemplary Embodiments 

15 

The number of accidents due to fatigue has increased sharply 
in the past few years. In Germany such accidents cost 
approximately 10 billion euros a year. The reason is driver 
fatigue, in addition to alcohol. There is a need in particular 
20 in commercial vehicles. Such systems are classified as driver 
assistance systems and are expected to experience considerable 
growth in the future. Different concepts exist today to 
prevent a driver from falling asleep. As a rule, systems which 
monitor the driver's voice or monitor the driver via a video 

2 5 camera and take appropriate measures to prevent the driver 

from falling asleep are used. 

According to the present invention, an artificial passenger, 
i.e., a person or another object, is projected, preferably in 

3 0 the area of the passenger seat to support the driver and warn 

him of fatigue. Holographic techniques may preferably be used 
for this purpose. The system may be conceived as an extension 
of existing systems or as a standalone application. The driver 
may select a pleasant male or female conversation partner via 
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appropriate memory devices and menus. Pets or other objects 
may also be projected. 

The artificial passenger may be projected as an optical image 
5 in the area of the passenger seat or the back seat . The 

artificial graphic passenger converses with the driver and 
entertains the driver on long trips. The system is designed in 
such a way that the driver may select what the projection is 
to look like. For example, it is conceivable that a business 
10 partner, who then talks over a hands- free device, or a person 
close to the driver such as a spouse may be projected. 

The system is configured in such a way that a check is first 
performed to determine whether the passenger seat is occupied. 

15 This is accomplished via a seat occupancy recognition system 
or via optical systems. Weight -based systems or, as mentioned 
previously, occupant sensing via optical, infrared, 
ultrasound, or radar waves may be used as a seat occupancy 
recognition system. Another system, known as a passenger 

20 assistance system, checks the driver's input or external 
communication means such as the telephone and gets the 
appropriate passenger to be projected from a memory medium. 

Another input into the control unit may be the input of a 
25 driver assistance system which also contains a fall -asleep 
warning system. This input is selected to determine an 
appropriate response. The advantage is that the driver may 
conduct a conversation and also feels like somebody is 
present. Furthermore, the driver may be better motivated to 
30 take a rest. In general, this principle is another possible 
application in transportation as a communication or safety 
system. 
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Figure 1 schematically shows a driver 3 and a projected 
passenger 2 in a vehicle 1. The projection of this figure 2 
makes it possible for the driver to conduct a conversation and 
obtain valuable driving instructions from passenger 2. These 
5 instructions may concern driver 3 himself, for example, if the 
sensor system detects driver fatigue or stress situations, or 
it may concern technical information which may be communicated 
to the driver by the passenger, so that the driver possibly 
drives to a service location or personally performs technical 
10 service on vehicle 1. 

Figure 2 shows a block diagram of the device according to the 
present invention for projecting a figure in a vehicle. A 
logic 201, preferably a microprocessor, is the core of the 

15 device. Processor 201 activates holographic projection system 
202, which projects the image, i.e., hologram 203, in vehicle 
1. Instead of holography, other projection techniques may also 
be used. Future three-dimensional projection techniques are 
also conceivable here. Processor 201 is connected to a seat 

20 occupancy recognition system 208. Seat recognition system 208 
is used to recognize the occupancy status of the individual 
seats in vehicle 1. Seat recognition system 208 may be 
designed as a weight -based sensing system or, as described 
previously, using sound waves, optical waves, or microwaves. A 

25 hologram may only be generated on an unoccupied seat. 

Furthermore, processor 201 is connected to a driver assistance 
system 204. Driver assistance system 204 is designed in 
particular as a f ailing-asleep prevention system. Driver 3 is 
also supported technically by driver assistance system 204 via 

30 projected figure 2. Technical support means that the driver is 
given valuable instructions for driving the vehicle. Processor 
201 is informed via block 206 what hologram 203 is to look 
like. This is accomplished by inputs by driver 3 via input 
devices, which are not depicted here for the sake of 
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simplicity. These inputs may also be stored data brought into 
vehicle 1 by driver 3. However, driver 3 may also compose or 
select an appropriate figure via input devices. For this 
purpose, a connection may be established, for example, to the 
5 Internet, i.e., an external memory. However, block 206 is also 
connected to communication means, such as a telephone 2 07, 
which may also determine the representation of hologram 203. 
The device may be configured in such a way that in the event 
of a call, the projected figure looks like the caller. The 
10 data for this purpose may already be stored in memory 2 05 or 
is transmitted via communication means 2 07. The caller may be 
scanned at the other end of the telephone connection to 
project a live image in vehicle 1 of the caller. 

15 Figure 3 shows another block diagram of the device according 
to the present invention. Processor 301 is connected to a 
holographic projector 3 04 which projects the appropriate 
figure as an artificial passenger. Furthermore, processor 301 
is connected to a microphone 303 and a speaker 302, which are 

20 used as a voice input/output system. For this purpose, 

processor 301 or the associated processors have voice analysis 
algorithms and speech synthesis algorithms. Stored speech may 
also be used here. Recorded speech of the driver in particular 
may also be used for analyzing the driver 1 s emotional state. 

2 5 This may be supplemented by a camera 3 05 and other biometric 

sensors used alternatively or additionally. These other 
biometric sensors will also be sensors connected to the 
driver, for example, to record his/her pulse rate. It is 
furthermore possible that image analysis algorithms are 

3 0 assigned to camera 3 05 for conclusions to be drawn from the 

image regarding the condition of driver 3 . An emotional state 
recognition system also belongs to this algorithm which 
recognizes whether the driver's eyes are wide open or 
gradually closing. Furthermore, processor 301 is connected to 
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a vehicle sensor system 306. Vehicle sensor system 306 is used 
for projected passenger 2 to convey important technical 
information to driver 3, so that driver 3 may better respond 
to a certain driving situation or the technical condition of 
5 the vehicle. Finally, processor 301 is connected to a 

transceiver device 3 07, which transmits and receives data via 
an antenna 308. This may be a mobile telephone, for example. 

If the driver selects three characteristics of the figure to 
10 be projected, this may be done by appearance, voice, sex, and 
size. Other attributes, such as clothing, may also be selected 
here. For example, the driver may specify whether he/she 
wishes to see the entire figure or only parts thereof. The 
technical information transmitted by artificial passenger 2 to 
15 driver 3 includes, in addition to a falling-asleep warning, 

advice to observe rest periods, to stop at a service station, 
or to perform some other technical service on the vehicle. The 
functions shown in Figures 2 and 3 may also be further 
combined or only parts thereof may be used. 
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Abotract 



ABSTRACT 



A device for projecting an object in a space of a vehicle is 
described. This object is preferably projected 
holographically , and a voice input and output system is 
assigned to this object. An artificial passenger is thus 
created for a driver. 

(Figure 1) 
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